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ABSTRACT 


This study describes an experiment designed to investigate 
potential advantages and/or disadvantages of color-coding 
relative to symbol- or alphanumeric-codes. Performance was 
evaluated in terms of reaction time and the number and type 
of errors made. 

The stimuli used in the experiment were the letters: E, F, 
Neeee the colors: red, yellow, green, blue, and the symbols: 
Samemes triangle, circle, and cross. They stood for enemy, 
friendly, neutral, and unknown forces, respectively. 

The analysis of the data obtained from the experiment 
Suggested that the color- and symbol-codes were significantly 
better than the alphanumeric-code with respect to the number 
of errors. The reaction time of the color-code was shortest, 
followed by the symbol-code with reaction time for the 


alphanumerics being longest. 
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I, INTRODUCTION 


mete are Many stamulli that people sense directly (e.¢g., 
color, sound). However, there are many situations and 
environments (e.g., stimuli below threshold values or stimuli 
to which people are not responsive as X-ray radiation) in 
which information that people need in performing some 
activity must be presented by the use of a display. A 
display, in general, is any device or medium that is used 
to convey information to an operator. Displays can be 
either dynamic or static. 

Dynamic displays are those that change through time, 
aoeeeeopeedometer, television, or radar displays, while static 
displays remain fixed over time such as charts. Another 
feature of a display is whether it is formatted, unformatted, 
or whether it has a variable format. 

Formatted displays have a fixed format such as specified 
scales or intervals like a thermometer. On unformatted dis- 
plays, random stimuli are presented. A display with variable 
format is a combination of the other two. An Air Control 
Radar display, for example, has a variable format with fixed 
Stimuli for the contours of landmarks and runways and random 
Seamus £Or incoming aircraft. 

A variety of information can be presented by displays. 
mie intormation can be: 

1. quantitative as temperature or speed, 


2. qualitative by indicating a change of a variable 
Oia kame te © ; 
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3. status indication such as on-off, 
4. signal indicating an unsafe condition, 


5. presentational information such as blips on a 
cathode ray tube (CRT), 


6. identification information used to identify a static 
Condition, situation or object. 


7. alphanumeric or symbolic information such as 
musical notes, computer printouts, or 


8. time-phased information such as Morse code. 

This study is concerned with dynamic, unformatted dis- 
plays with symbolic information such as might be used on CRTs 
for military purposes. Since World War II, these display 
types (e.g., radar, sonar) have been widely used and, as the 
weapon systems are getting more sophisticated, more informa- 
tion has to be displayed. In connection with external sensors, 
the computer aided displays not only present the blip of 
a radar contact; they provide additional information mostly 
in the form ot alphanumeric codes such as classification, 
track-number, speed, altitude, etc. 

Performing an activity with these displays requires an 
Sentenced Operator to read the complex displays and to 
distinguish between relevant and irrelevant information/noise. 
Simultaneous to this increased complexity has been an increase 
in the workload of the operator in modern military systems. 
For example, the pilot of a single-manned fighter airplane 
is not only the pilot of a high-speed aircraft in the conven- 
tional sense; he is also a navigator, a tactical coordinator, 
a communications officer, and a weapon officer with responsi- 
bility for his expensive system and control of his weapons 


(nuclear warheads). a 





To improve efficiency, various methods of coding the 
increasingly complex information have been attempted. For 
example, in manual and computer-driven plotting systems, 
colored symbols (e.g., blue for own forces and red for hostile 
forces) may be used to make it easier for the operator to 
Mmimernpret the Situation, and to reduce the reaction time to 
displayed information. 

Today's state-of-the-art in electronic engineering 
Suggests the possibility of using color-codes on tactical 
displays as well as in manual plotting systems. However, 
this coding technique is far more expensive than the 
MOone@cnromatic ones, and it has to be examined to determine 
whether the color-code technique does really have an advantage 
over less expensive coding techniques such as alphanumeric- 
or symbol-code. 

Therefore, the experiment as reported here will test the 
three coding modalities to find out whether the color-code is 
mpemeror tO the other codes with respect to reaction time and 


to the number of errors made. 
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i Sree ATURE REV LEW 


A. COLOR CODE AND PERFORMANCE 

Considerable research has been performed on the applica- 
tion of color as a coding modality. For example, studies 
Bpemaret (1961), Christner and Ray (1961), Cook (1974), 
mimeo (1975), Wagner (1977), Teichner et al. (1977) have all 
-eummed cOlor-aided displays. However, no definite conclu- 
Slon 1S available that suggests color has an advantage over 
other coding modalities. 

Specially, the literature dealing with color coding and 
performance does not lead to a specific conclusion relating 
increment or decrement in performance as a result of using 
cOlor coding. Burdick et al. (1965) reviewed both the litera- 
ture on color coding and the state-of-the-art for CRTs and 
emphasized a cost-effectiveness approach. They concluded that 
color CRTs were probably worth the additional cost for some 
tasks, such as search tasks, at the time of their writing. 

Oda (1977) summarized an experiment of a color-coded, computer- 
aided multipurpose display (MPD) for the TACCO of an S-3A 
Viking and found that the color-coded MPD tended to improve 

the functional effectiveness of TACCOs with low experience 
levels. This, of course, does not answer the total question 
about benefits of colored CRTs. 

On the other hand, Teichner et al. (1977) concluded that 


color-coding is of little benefit with regard to performance 
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Baamenhaist ana Corso (1975) indicated, after performing a 
series of experiments with colors, letters, digits, and 
symbols, that performance with color was not superior to 


the other codes. 


Beewor OF COLORS EN CERTAIN TASKS AND SITUATIONS 
Smith (1978) summarized the existing literature and 
related the best coding methods to certain tasks. This 


summary 1S given in Table I. 


Table I 


Task and Recommended Coding Methods 


1S te Coding 2nd Coding 
Function Method Method 


Search Where is it? Color Number or 
Letter 


Identify What is it? Number Petlex: 
Counc How many? Number Golor 


Compare Yes/No Number Color 


Verify True/False Number Color 





Krebs et al. (1978) have suggested that color may be of 
bemetit in the following Situations: 

1. The display is unformatted. 

2. The symbol density is high. 


3. The operator must search for relevant information. 
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4, The color code is logically related to operator's 
task. 


S$. The symbol legibility is degraded. 

In addition to these criteria, Smith (1978) suggested 
that color may be of benefit as a coding modality if the 
target position is unknown, but the color of the target is 
Moun his restricts the use of colors to certain types of 


Situations such as in search tasks. 


fea TATION OF THE NUMBER OF COLORS 

A major shortcoming of color is the number of dimensions 
that can be coded when color is the selected coding modality. 
The number of dimensions that can be coded is limited to four. 
This 1S a common finding of color researchers. Hanes and 
Rhoades (1959), Ruch (1966), Krebs et al. (1978), and 
Wagner (1977) stated that up to about 50 colors may be 
identified with extensive training, but in the applied sense, 
they agreed that if identification is required, the number 
of colors should not exceed four. 

Krebs et al. (1978) summarized the criteria for selecting 
@ Specific color set: 

1. Maximize wavelength separation. 

feeeen color contrast. 
Seon Visibility in specific application. 
4. Compatibility of the use with conventional meanings. 
5. Legibility and ease of reading. 


6. Highly saturated colors preferable. 
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D. COLORS AND THEIR CONVENTIONAL MEANING 

Some colors have a conventional meaning. For example, 
red means danger or stop. Smith (1978) listed some colors 
in relation to their conventional meanings and to the 


operators' reactions. (See Table II.) 


Table II 


Colors and their Conventional Meanings 


Meaning Operators' Reaction 


Flash Red Emergency Immediate action required. 


Red Alert Corrective action must be 
taken. 


Yellow Advice Camenon wm Geeheck Necessary . 


Green Proceed Condirronm OK. 


White Transitory No wrong or right indication. 
Pune ton 


Blue Advisory Should be avoided. 





E. LUMINANCE, BRIGHTNESS, CONTRAST, SATURATION 
Other factors that influence performance in using 
colored displays include: 
1. Luminance 
That is the amount of light emitted from a display 
surface (luminous intensity) as viewed by the observer. The 


subjective measure of luminance is brightness. 
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ee br Lentness 
Brightness refers to a subjective impression of 
relative luminance. That is, a symbol of fixed luminance 
Will appear brighter on a dark background than on a light 
background. Thus, brightness judgments are at least in 
part influenced by contrast. 
5. Contrast 
Contrast 1S a measure of the relationship between 
the luminance of a symbol and its background. 
4. Saturation 
The colors themselves are of different purity. For 
example, the two colors pink and red have nearly the same 
hue; that is the attribute of a color to which commonly used 
labels such as green are assigned, but red would be much 
more saturated than pink. Black, white, and gray have a 
Saturation value of zero. Judd and Wyszecki (1952), cited 
in Haber and Herschenson (1973), utilized Figure 1 to 
explain color saturation. Saturation is the relative 
purity of a color defined in terms of its departure from 


a white or gray of the same lightness. 


F, SYMBOL SIZE 

Femeoptimal perception of color, not only is color satura- 
tion of importance but also the size of the colored targets. 
Krebs et al. (1978) recommended sizes from 21 to 45 minutes 
of an arc (in terms of visual angle) depending on the number 


of colors used in the code (see Figure 2), and they stated 
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LIGHT 
(winste, dazziing) 


LIGHTNESS —* 


(brightness) 


OARK 
(black) 


Note: The four hues shown are of 
the same saturation value. 


Figure 1. Color Saturation 
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Figure 2. Symbol Size versus Number of Colors 
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that color perception may be adversely affected if the symbol 
size is below 21 minutes of an arc. 

If luminance contrast, however, is low, or the display 
readability is degraded by noise and/or poor resolution, 
the symbol size should be increased beyond the minimum 
recommended levels. 

All these factors -- number of colors, size, tasks, 
Situations, conventional meaning, luminance, brightness, 
contrast, and saturation -- are important not only by 
themselves but also in all their possible combinations and 
interactions in discussing and evaluating performance with 


wouon-coded displays. 
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The objective of this experiment was to test the Null 
hypothesis that there is no difference between the three 
coding modalities, colors, symbols, and alphanumerics, with 
respect to human performance measured as reaction time and the 
number of errors. The alternative was that one coding tech- 


nique is superior to the other codes. 


A. EXPERIMENTAL DESIGN 
1. General Description 

In most modern military systems, operators are 
expected to perform simultaneously multiple tasks such as 
miyame an aircraft or navigating in addition to monitoring 
a tactical display and making decisions based on the informa- 
tion provided. Kopala (1979) performed a simulation experi- 
ment with pilots. Pilots simultaneously performed routine 
flying tasks, while monitoring the display, but she compared 
symbols with the redundant colored symbol code. The task 
selected for this experiment, however, involved only a search 
task and a choice reaction task (identification). As in case 
of a CRT for a pilot, we have an unformatted display with 
moderate to high contact density; further the pilot has to 
search the display for relevant information. 

The experiment itself was divided into three sub- 
experiments. The subjects were shown decks of cards with 


either symbols, colors, and alphanumerics. Within each 


alt 








deck of cards were five "target cards.'"' Target cards were 
those cards that presented a specific letter, symbol, or 
colored dot, which were known in advance by subjects. 
Targets in this context could mean anything to the subjects, 
e.g., an attacking missile, a hostile fighter, or something 
specified in their missions, 

2. Stimuli Presented 

Simce the recommended number of colors is four, 
only four symbols, colors, and alphanumerics were used. 
This variable was held constant to obtain the same number 
of dimensions in the three sub-experiments. 

The human eye is limited to a visible spectrum 
of electromagnetic radiation with wavelength from 380 
nanometers (violet) to 750 nanometers (red). Out of this 
spectrum, the following four colors were chosen for the 
experiment: blue, green, yellow, red. 

These colors were selected not only because of their 
high wavelength separation; they were also logically related 
to the task of the operator and are compatible to conventional 
meanings. Further, these colors are well saturated and no 
confusion has been reported by subjects. The diameter of the 
colored dots was 3.1 millimeters. This corresponds to about 
35 minutes of an arc at a viewing distance of 30 centimeters, 
which is more than the minimum size of 31 minutes of an arc 
suggested by Krebs et al. (1978). 

The colors, alphanumerics, and symbols selected for 
the experiment are shown in Table III together with their 


possible meaning. 
Ze 





Table III 


Stimuli for the Experiment and their Meaning 


Symbol Alphan Possible Meaning 


Red Dot Enemy oO ainae i 


Yellow Dot Unknown Unidentified , 
meCeh GLO? 


fmecn Dot Friendly, No Danger 


Pie Dot Neutral, No Danger 





The alphanumerics and the symbols were of the same 
Size as the colored dots with a stroke thickness to height 
of about 1:6 and in case of the letters with a width-height 
ratio of 3:5 as recommended in McCormick (1976). The symbols 
are commonly known and easy to discriminate. Some of the 
Symbols are used in existing codes, for example, on German 
Fast Patrol Boats. 
The four letters were chosen because they are the 
first letters of the word and could serve as abbreviations: 
F - Friendly 
U - Unknown 
eee Tre ty, 
N - Neutral. 
Target cards were those cards with a red dot, a 
triangle, or an E. There were 10 stimuli on each 12 x 8.5- 
meamermeter card. A deck of cards consisted of 40 cards with 


either alphanumerics, colors, or symbols. The five target 


LS 





cards were randomly distributed within the decks using the 
Uniform Random Number generator of the hand-held calculator 
meso (Statistics Module, Program 02). The positions of the 
target cards within each deck were changed for each subject. 

Superimposed on the 120 cards was a single card with 
colors, alphanumerics, and symbols not used on the other 
cards. This card represented noise or disturbances. It 
should make the task more realistic because noise is also 
found on radar scopes and other displays. A single noise 
card was used throughout the experiment to hold this variable 
constant and to prevent the possibility that several noise 
cards influenced performance differences. For the same 
reason, the number of stimuli presented per trial (density) 
was the same; there were 20 stimuli on the noise card in 
addition to the 10 stimuli per signal card. 

No attempt was made to control the position of the 
Stimuli on the card. All stimuli were put on the card in 
a random fashion; superposition was avoided. 

3. Procedure and Outcomes Measured 

A random number generated from the discrete Uniform 
Distribution between one and six (TIS59 Statistics Module, 
PGM 02) determined in which sequence the three decks of cards 
(one deck for each code) were presented. The possible out- 
comes and the resulting sequences are listed in Table IV. 

Within the three decks of cards, each card was 
M@eeaenced to the subjects for 1.5 seconds. During this 


time, they had to search the card and determine whether or 
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Taine may 


Sequence of Code Presentation 





Random 

Number sequence 
sl alphan. - colors - symbols 
2 alphan. - symbols - colors 
5 colors - alphan. - symbols 
4 colors - symbols - alphan. 
5 Symbols - alphan. - colors 
6 Symbols - colors - alphan. 


mot 1t Was a target card. Subjects were required to identify 
mumaca cdot, the triangle, or the E, respectively, and to 
respond to the target cards by pressing a button. The out- 
comes measured were: 


h] Reaction time. That is the time from first showing 
the target card until the subject 
responded. The reaction time in- 
cluded information processing (de- 
cision), a central response, and the 
movement time. 


2. Number of errors of omission. These are those errors 
that occurred where the subject missed 
a target card or responded too late 
(after presentation of the card). 


3. Number of errors of commission. These are the errors 
that occurred where the subject re- 
sponded to a non-target card (False 
Alarm). 

The subjects did not know how many target cards 


were within the decks of cards. They were informed that 
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the probability of viewing a target card was much lower than 
0.5. (See Instructions, attached as Appendix A.) 

Prior to the experiments with the three decks of 40 
cards, three "warm-up runs' had to be completed by the sub- 
jects. In these runs, 10 cards of each code were presented 
to the subjects. The probability of viewing a target card 
here was 0.5 (every other card). These trials familiarized 
the subjects with the stimuli equipment and ascertained 
that the instructions were understood. 

Between each sub-experiment, breaks of two minutes 
were given to the subjects to avoid possible fatigue effects 
and to set up the next sub-experiment. Smoking was not 
allowed while performing the experiment to avoid possible 


performance degradation due to reduced oxygen. 


B. APPARATUS 
The stimulus presentation apparatus used was a 
Tachistoscope G1130 Model T-3A manufactured by Ralph 
Gerbrands Panay. It consisted of: 
1) 3-Field Exposure Cabinet 
2) 6-Channel Digital Timer 
3) 3-Field Lamp Driver 
4) Logic Interface (G1159) and 
5) Automatic Card Changer (G1150). 
The physical set-up of the equipment is shown in Figures 3 and 


4. The tachistoscope is an instrument for providing very 
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brief timed exposure of visual material as images, letters, 
Seeaigvits. It is a tool in learning, attention, and per- 
ception studies. 

The exposure cabinet had three viewing fields into which 
visual material could be placed. These materials are shown 
to the subjects via a system of mirrors. Superposition is 
possible. Two of the viewing fields are semi-automatic; 
that is, the cards have to be placed in the field manually. 
The third field is connected to the Automatic Card Changer 
in which up to 100 cards can be preloaded. 

The Digital Timer normally times the Automatic Card 
Changer and the Lamp Driver. The Lamp Driver supplies drive 
current to the lamps in the Exposure Cabinet. The Logic 
Interface is placed in series between the Timer and the Lamp 
Driver. By using controls, it is possible to operate any 
of the three viewing fields of the Tachistoscope with any 
of the six channels of the Timer. 

For this experiment, a Digital Equipment Corporation 
Lab 8/E computer was used to record the responses. The com- 
puter was connected to the Card Changer and the response 
button (Figures 3 and 4). The response button was placed 
under the viewing hood in front of the subject. 

A Basic (computer language) Program, provided by the 
Human Factors Laboratory of the Naval Postgraduate School, 
was used to time the Automatic Card Changer, to count the 


errors of commission and omission, and to measure the 


oe 





reaction time to the one-hundredth of a second. The Basic 
Program is attached as Appendix B. 

The noise card was placed in one of the semi-automatic 
Viewing fields and superimposed on the decks of 10 cards 
Or the "warm-up runs," and the decks of 40 cards of the 
"hot runs,'' respectively. 

Except for the computer, the terminal, and the Interface, 
the equipment was placed in an "Industrial Acoustic Co., Inc. 
Control Acoustic Environmental Chamber" to minimize distrac- 
tion of subjects while performing the experiment and to have 


the same environmental conditions for all subjects. 


fee SUBJECTS 

Twenty-three students and one member of the faculty of 
the Naval Postgraduate School volunteered as subjects for 
this experiment. All 24 subjects were military officers. 
Miteyewere from six different countries, USA (11), Germany (9), 
Canada (1), India (1), Israel (1), and Korea (1). Twenty 
subjects were from the Operations Research Department, four 
from other departments of the Naval Postgraduate School. All 
were of age between 27 and 39. Subjects were asked before 
performing the experiment about color defects; none were 
reported. As the subjects were officers, they had been 


military screened and corrected to 20/20 vision. 





IV. ANALYSIS AND RESULTS 


A. ERRORS 
The percentage of errors made by the 24 subjects under 
the three codes are given in Tables VI and VII of Appendix C. 
Table VI shows the percentage of errors due to errors 
of omission, Table VII the percentage of errors due to 
errors of commission. 
The nonparametric test "Friedman Two-Way Analysis of 
Variance by Ranks" (Siegel, 1956, p. 166) was conducted 


femeest the Null hypothesis, 


Ho > the three coding techniques have no differential 
effects on the number of errors of omission/commis- 
Salome. 


against the alternative, 


Hy : the three coding techniques have differential effects 
em the Number OL Crrors Of OMi1SsiOn/COnmisston. 


The teststatistic for this test is computed by the formula 


k 
bo yen 5 (Ri) Se vG cane 


where N is the number of subjects, 
k the number of codes, and 


Ri the ranksum of code j (column ranksum). 


Bomelarge N (> 10) the test statistic 1s approximately CHI 


SQUARE distributed with k-1 degrees of freedom (df). 
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An a-level of 0.05 was used throughout all Hypothesis 
mests. 
1. Errors of Omission 
In case of the errors of omission, the following data 


were used to calculate the test statistics: 


pee 0.05 , k = 3, Ry faloliait.)) t= ae0 2). 5 5 
Meee c4 , df = 3, R, Keeleus) sy -moo. 5, .and 
Re (symbols) = 42.5 


This resulted in a value for the chi square test 


Set rstic of xe = 13.27. The corresponding probability 
obtained from a chi square table (Siegel, 1956) 1s approxi- 


1s 


feeoty 0.001. As p ~ 0.001 is less than a = 0.05, Ho 


rejected. 

Although there is no range test available to indi- 
cate where the differences are, it seems to be obvious that 
the alphanumeric code differs from the other two codes 


and R while R.~ and R 


because Ry was much larger than R, 3> 7 


3 
were quite similar. 
2. Errors of Commission 


For evaluation of the errors of commission, the follow- 


ing data were computed to calculate the test statistic: 


ome .05 , k = 3, Ry (alphan.) = 59, 
feeee4 46, «di = 2, R, (oO ones) ee a oe a fic. 
Re (symbols) = 41.5 


Here the test statistic was xe = 7,65 with an asso- 


erated probability of p ~ 0.02, and as p was less than a, 
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the Null hypothesis was rejected. For the same reason as 
above, a difference of the alphanumeric code versus the other 


GworPcodes 1S concluded. 


BemeekEACTION TIME 

The observed reaction times are listed in Appendix E, 
Table IX. First, the mean reaction times of the subjects under 
the three coding techniques were analyzed by the "Friedman 
Two-Way Analysis of Variance by Ranks" to test the Null 


hypothesis, 


H the three coding techniques have no effect on the 


: mean reaction time of the subjects, 


against the alternative, 


Hy : the three coding techniques have differential 
effects on the mean reaction time, 
The mean reaction times in seconds are given in Appendix D, 
maple VIII. 
The following data were used to calculate the chi square 


mest Statistic: 


N = 24 Boeke s 5% Ry (alphan.) = 68, 
@e= 0.05 , df = 2, R, (colors) = 24, and 
= 52 


Rz (symbols) 


This resulted in a value of x = 454 Withean associated 
probability of less than 0.001 which is less than the 
selected a-level. Therefore, Hy 1s rejected and differences 


between the three coding modalities with respect to reaction 





times are concluded. Regarding the ranksums of 24, 52, and 
68, the only actual conclusion that can be drawn is that the 
reaction time of the color code technique is significantly 
faster than the reaction time of the alphanumeric code. 
Therefore, the parametric test "Analysis of Variance" (ANOVA) 
(Hicks, 1973) was applied to the data. A comparison of the 
Boxplots (McNeil, 1977) shown in Appendix F, Figure 5, how- 
ever, indicated the non-homogeneity of the variances and 
positive skewness of the data. 

In order to obtain homogeneity, McNeil (1977) suggested 
a series of transformations that can be applied to the raw 
data. Within the root transformation, the fifth root turned 
out to be best. The resulting Boxplots in Figure 6 of Appendix 
F show that the Midspreads, that is, the spread from the 
25th to the 75th quantile, are nearly the same, and that 
most of the positive skewness disappeared. The transformed 
data are attached in Appendix E, Table X. A summary table of 
the original and the transformed data is given in Table XI of 
Bopendix E£. 

To test the Null hypothesis, 


H the variances are the same, against the alternative 


0 


H the variances are not homogeneous, 


1 


Bartlett's Test (Brownlee, 1960) was conducted. 


34 





k S. 
: isl ee Ba 
The test statistic, TS = ————————_ _, 1s 
: iL Ih 
dvd = y - 
S(k-1) 523; F 


chi square distributed with k - 1 degrees of freedom. 
f is the number of data minus the number of columns, 


f. is the number of data in column 1 minus one, 


me , ; 
S$; is the variance of column 1, 


k is the number of columns, and 


5? 1S calculated by the formula 


To calculate the test statistic, the following data 


were used: 


Sy = 0.0035 fo = 87 f = 319 
i z Co 2 
S, = 0.0024 f, = 117 Ss = 070031 
inoss  €2= 115 df= 2 
o 
imrs resulted in a test statistic of 7 = 4,38. The 


corresponding probability of about 0.12 is more than the 
a-level of 0.05. Hy is accepted; homogeneity of the three 
Variances is concluded. 

Inspection of the Stemleaf plots (McNeill, 1977, p. 2), 
given in Appendix G, indicated that the data of the three 


columns were normally distributed. 


55 





The summary of the two-way ANOVA is given in 


Table V. 


Vable Vv 


ANOVA Summary 


Source 


Code 


Subjects 


Codes X 
Subjects 


error 





meee 05 


fae <) ,01 


The results of the ANOVA confirmed that there are 
differences in reaction time between the three coding modali- 
ties. As the critical value for 2 and 250 degrees of freedom 
1S approximately 3 (Hicks, 1975, tables), the obtained F-ratio 
of 130 indicates high significance. The F-ratios for the 
Subjects and for the interaction of subjects with codes are 
also significant at the 0.05 level, but much less than the 
ratio for the codes alone. 

For the codes, the Newman-Keuls range test (Hicks, 1973, 


p. 35) was conducted to analyze between code differences. The 
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Standard error of the mean for each code was 0.005 for colors 
and symbols and 0.006 for alphanumerics. This resulred in 
values for least significant ranges of 0.0139 and 0.0166 for 
differences between adjacent (ordered) mean values and 0.0166 
and 0.0199 for every other mean value. As all three differ- 
ences between the means of the codes: 

colors versus symbols 0.069 

colors versus alphanumerics 0.123 

symbols versus alphanumerics 0.054 
exceeded the least significant ranges, differences in 
reaction time between all three codes are concluded. That 
is, the reaction time of the color code is shortest, followed 
by the symbol code, and the reaction time for the alpha- 


numeric code is longest. 
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V. DISCUSSION AND CONCLUSION 


The data obtained from the experiment therefore suggested 
that the color- and symbol-codes are superior to the alpha- 
numeric code with respect to the minimum number of errors 
made, and that with regard to the reaction time the color 
code is superior to the other codes, followed by the symbol 
Eode . 

Although the ANOVA gives strong evidence that there are 
differences between the three coding modalities, the result 
was to be treated with caution. As the exposure time of the 
cards was exactly 1.5 seconds, all reaction times exceeding 
this value were lost. In case of the colors, two reaction 
times were truncated for the symbols four, and in case of 
alphanumeric code 32 data were truncated. The truncation 
of the reaction time data, mainly for the alphanumeric 
code, led to an underestimation of the mean values. As, 
however, with the underestimated mean value for the reaction 
time of the alphanumeric code, ANOVA suggests significant 
differences; it would give an even more significant difference 
if all reaction time data for the alphanumeric code were in- 
cluded. For this reason, the conclusions drawn from the 
ANOVA test are justified. 

Nevertheless the general statement that the color code 
1S superior to the other coding techniques under all conditions 
cannot be made because of the following limitations imposed on 
the experiment: 
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Io Artiticial Environment 
The experiment was carried out in a controlled 
artificial environment that eliminated most sources of 
environmental load imposed on the subject as noise, different 
light conditions and temperature. Further, because of the 
Short duration of the experiment, no significant additional 
load because of fatigue effects could arise. And more 
important, during the experiment the subjects had only a 
Single task (scan the cards, search for a target, identify 
it, and respond) while under operational conditions, an 
operator has multiple, complex tasks to perform which may 
impose a large workload. Under these conditions, different 
results for the three codes may be obtained. 
2. Selection of Subjects 
The selection of subjects was not random. All 
subjects were from the Naval Postgraduate School population. 
This sample represents neither the whole population nor the 
population of pilots. Therefore, the conclusions are only 
valid for individuals with backgrounds similar to those of 
Naval Postgraduate School military officers. 
SB. ocelection of Stimuli 
The selection of stimuli imposes another limitation 
on the results because the results can only be regarded with 
respect to the three sets of stimuli used in the experiment. 
Different sets of symbols and/or alphanumerics may lead to 
different reaction times and different percentages of errors. 


The color code in general seems to have an advantage because 
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some colors have a conventional meaning while symbols and 
alphanumerics do not. In addition, the two alphanumerics 
E and F, used in the experiment, might have increased the 
7Oad On the subject because of their similarity. To dis- 
criminate between these letters probably two fixations were 
necessary which might have caused longer reaction times and 
more errors. Also, the letter F could have been erroneously 
Interpreted as foe. Further, the experiment emphasized the 
search task because the finding of the target included 
probably at least for the color code the identification of 
the target. Therefore, the results concerning the reaction 
pilmemwere not surprising as it is known that the color code 
has the shortest search time. 

Even if repeated experiments with different sets of 
Stimuli and different subjects under more load confirm the 
results obtained from this experiment, there are some 
factors that have to be regarded before colored CRTs can be 
Me@lazed in the cockpit of aircraft: 

ae raining . 

The advantage of colors versus symbols in 
reaction time might be overcome by training. Research should 
be done in this area and the cost of additional training 
compared with the cost of a color display. 

b. Number of Dimensions that Can Be Coded with Color 

As the number of colors was limited to four, 


only four dimensions could be coded with colors. Coding of 
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more dimensions with colors will lead to performance 
degradation. Another coding modality (e.g., colored symbols) 
Should be used for this case, thus utilizing the principle 
of redundant coding. 
53. Ambient Illumination 
Brightness and contrast of displayed information in 
relation to ambient illumination is an important factor for 
display systems. With conventional color CRT displays, the 
brightness of the spectral colors is lower than can be 
Gptaimed with a black and white CRT. Therefore, the colored 
System must normally be operated in lower ambient illumina- 
tion. Infalling sunlight in the cockpit during daytime is, 
however, very high ambient illumination and can cause colors 
to wash out and to reduce saturation. 
4. Peripheral Color Vision 
Color cannot be sensed in the peripheral area of the 
retina and vision becomes dichromatic at approximately 60 
degrees from the fovea (Krebs, 1978). This zone varies from 
individual to individual. The lack of color vision in the 
periphery sets constraints on the location of the colored 
splay . 
Seeecolor Vision Defects 
There are several types of color vision defects, but 
these defects should not influence the decision whether to 
use a color display poets only eight percent of the healthy 


male population (female 0.4%) have some kind of color defects. 
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These individuals are excluded from most military jobs by 
Screening. However, before extending the use of colored 
displays for other types of jobs, these personnel have to 
be screened, and the number of operators will be restricted. 
Perhaps some operators that perform well on monochromatic 
systems will be eliminated from their jobs. 
feeeecost, Reliability, Readiness 

Not only the procurement cost for a colored CRT is 
ieegher than for a black and white CRT (about 20%); also the 
maintenance cost will be increased due to more sophisticated 
maintenance equipment and better trained maintenance personnel. 
Further, a shorter lifetime and shorter maintenance intervals 
can be expected in combination with longer maintenance time. 
This leads consequently to a reduction in the availability 
of the aircraft and therefore to a decrease in their 
readiness. 

Although most people like colored displays, the 
above factors have to be considered before selecting a colored 


display. A cost-benefit analysis should be performed. 
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APPENDIX A 


INSTRUCTIONS FOR CODING EXPERIMENT 


ieeeeoojectives of the Experiment 
The objective of this experiment is to find out whether 
there are differences between several coding modalities with 
respect to reaction time and the number of errors made. 
An application might be the coding of a tactical display 
On board airplanes. 
ime coding modalities used in the experiment are: 
- alphanumerics, 
- colors, and 
- symbols. 
Today's state-of-the-art in electronic engineering allows 


all three coding modalities at different costs. 


II. General Instructions 

Each subject is shown three sets of cards with either 
alphanumerics, colors, or symbols by means of a Tachistoscope 
with automatic, computerized cardchanger. 

The following table shows the codes used together with 


their possible meaning: 


Symbol Alphanum. Possible Meaning 


Red Dot Enemy, Danger 


Yellow Dot Unknown, Unidentified 


Green Dot Friendly Forces 


Blue Dot Neutral Forces/contacts 
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Subjects have to search the cards and determine whether 
Pmemot they Show a red dot, a triangle, or an E, respectively, 
and respond to those, and only to those, cards by pressing a 
button placed under the Tachistoscope as fast as possible. 
Superimposed on the cards is a "noise" card to complicate 
the task. The number of errors will be counted, and the 
reaction time will be measured. 

The next figures represent samples of the three sets 
of cards. Note that they show an E, a red dot, or a triangle. 
Subjects have to respond to those cards while they are 
presented; a later response will be counted as an error. 
Epemea COITTect response a new card will be presented 
immediately. Otherwise the card stays in the viewing field 


ror 1,5 seconds. 


itis Procedure 
A. Determination of the Sequence 

The Random Number Generator of the hand-held calcu- 
lator TI 59 (PGM 2 of applied statistics module) will be used 
to generate random numbers drawn from the uniform distribu- 
tion between 1 and 6. These random numbers determine the 
sequence in which the codes will be presented. 

1 means alphanumerics - colors - symbols 


2 means alphanumerics - symbols - colors 


3 means colors - alphanumerics - symbols 
4 means colors - symbols - alphanumerics 
5 means symbols - alphanumerics - colors 
6 means symbols - colors - alphanumerics., 
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yoo Ss 


yellow dot 
Eueene dee 
blue dot 
Reda t 


B. Warm-up Phase 

After the subjects are seated in the booth, and the 
deck of cards is placed in the card changer by the experi- 
menter, the door will be closed and after 10 seconds the 
first 10 cards will be shown to the subjects in the viewing 
field of the Tachistoscope at a rate of one card per 1.5 
Seeomas. On identification of an E, a red dot, ora 
triangle, the button under the Tachistoscope has to be 
pressed. 

This will be repeated for the remaining two sets of 
cards. The probability of getting a card that requires a 


response is 0.5. 


Ga HOt Runs 
After completion of the warm-up phase, sets of 40 
cards will be placed in the card changer. The procedure, 
the sequence of the codes and the presentation rate will be 
the same. The probability of getting a card that requires a 
response, however, will be much lower. These cards are 


randomly distributed within the deck of cards. 


IV. Please do not smoke while performing the experiment. 


V. Thank you for participating in the experiment. 
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APPENDIX B 


BASIC PROGRAM 


REM - THIS PREAMBLE MUST PRECEDE ALL PROGRAMS 
REM - USING THE LAB8/E 'SPECIAL FUNCTIONS’. 

UDEF INI(N) ,PLY(Y) ,DLY(N) ,DIS(S,E,N,X) 

UDEF SAM(C,N,P,T),CLK(R,0O,S) ,CLW(N) , ADC(N) 

UDEF GET(M,L) ,PUT(M,L) , DRI (N) ,DRO(M,N) 

DIM A(100) 

PRINT'"NUMBER OF CARDS" 

INPUT Nl 

PRINT "ENTER VIEWING TIME IN 1/100 OF A SECOND" 
INPUT N2 

E0=0\E1=0\E2=0 

REM **********TNITIALIZE FOR SET OF 50 CARDS *##*XRRKKKER 
PRINT "ENTER SUBJECT'S NUMBER" 

INPUT Sl 

FOR I=1 TO Nl 

AOD lee 

NEXT I 

PRINT "ENTER TARGET CARDS EACH # FOLLOWED BY <RET>" 
FOR I=1 TO 5 

INPUT N 

ae =1 

NEXT I 

E0=0 \ E1=0 \ E2=0 

REM KReRKRRKKRAEKEKES RELEASE CARDS KRRKRRRRRRRRKRRRKRRKRRKKRKEKESE 
Z=CLK(2,500,0) 

Z=CLW(0) 

FOR I=1 TO Nl 

Z=DRI (0)\J=0 

Z=DRO(1,0) 

Z=CLK(2,23,0) \ Z=CLW(0) 
Z=DRO(0,0) \ Z=CLK(2,100,0) \ Z=CLW(0) 
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255 
240 
245 
250 
ZS 5 


265 
270 
ZS 
280 
300 
305 
320 
Sa 
550 
570 
380 
Shs 
420 
425 
430 
440 
450 
499 
pv 
SEA 
oS 
514 
Sule 
518 
520 
S10 
540 
545 
555 
960 


Z=CLK(2,1,0) 

Z=CLW(0) 

Z=DRI (0) 

JeJ+1 

IF Z<>0 GO TO 300 

REM RRKAKKREKNO RESPONSE YET KHRRKE RR RR RRRRR SR 
IF J<N2 GO TO 235 

REM *****%***% NO RESPONSE AFTER N2 CARDS **#**x*kxK XE 
IF A(I)=0 GO TO 399 \ REM CORRECT RESPONSE 

IF A(I)=1 GO TO 399 \ REM OMISSION ERROR 

IF A(1)=0 GO TO 370 \ REM COMMISSION ERROR 

IF A(I)=1 GO TO 320 \ REM TARGET DETECTED 

REM RREEKRARRKREKKERE COLLECT RESULT RRRARAERRARKRKKRREKSE 
A(I)=J 

GO TO 399 

A(I)=2 

R1=N2-J \ Z=CLK(2,R1,0) \ Z=CLW(0) 

NEXT I 

FOR I=1 TO Nl 

IF A(1)>0 GO TO 430\EO=E0+1\GO TO 499 

meeA(l)>1 GO TO 440\E1=E1+1\GO TO 499 

IF A(I)>2 GO TO 450\E2=E2+1\GO TO 499 

EO=E0+1 

NEXT I 

PRINT "RESULTS - SUBJECT NUMBER";S1 

ne ee " 
PRINT 

PRINT "NUMBER OF CARDS = '"';N1 

PRINT ''CORRECT RESPONSES ='';E0 

PRINT "COMMISSION ERRORS ='':E2 

PRINT "OMISSION ERRORS ="';E1 

PRINT 

PRINT "RESPONSE TIMES FOR DETECTED TARGETS" 
PRINT ‘'----------------------------------- it 

FOR I=1 TO Nl 

mEwA(T)<3 GO TO 570 
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565 PRINT TAB(20);A(I) 
570 NEXT I 

580 PRINT "IF ANOTHER RUN FOR THIS SUBJECT TYPE 1 ELSE TYPE 2" 
590 INPUT K 

Suomi K=1 GO TO 91 

670 PRINT "IF ANOTHER SUBJECT IS WAITING TYPE 1 ELSE TYPE 2" 
675 INPUT K 

eegmGr K=1 GO TO 91 

690 PRINT 

700 PRINT "END" 

998 STOP 

999 END 


READY 
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APPENDIX C 
PERCENTAGE OF ERRORS 


Table VI 


Pereentage Of Errors Due to Erroys of Omission 


Codes 


oubjects : Colors Symbols 





1 5 0 0 

2 9 0 0 

3 10 0 0 

4 0 0 Co 

5 0 0 0 

6 Te 0 0 

if 0 0 0 

8 10 0 0 

9 ios 0 0 
10 Zito 0 0 
1 Ln es 0 
eZ 0 0 0 
13 Lie 3 0 0 
14 0 0 0 
ES 10 0 0 
16 Due) Do Cie 
7 ceo 0 0 
18 0 0 0 
8 cee 0 0 
20 5 0 0 
Ze con 0 0 
ne 0 0 0 
eS oa 0 Cae 
24 5 0 Ze9 
X Se 5 O21 0.42 
G Sard h Opi aos 
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Table VII 


Percentage of Errors Due to Errors of Commission 


Codes 


subjects : Colors Symbols 





it 0 0 0 

Z 0 0 0 

5 Lees9 0 0 

ft Zar 0 0 

5 0 0 0 

6 0 0 0 

i 0 0 0 

8 Zo 0 0 

2 Ves 0 0 
10 Lo 0 0 
11 0 Ceo 0 
LZ 0 0 0 
eS 0 0 0 
14 0 0 0 
ib Ws 0 0 
16 Lied Ze 0 
L/ G25 0 0 
18 0 0 0 
OS) Lis) 0 0 
20 Lind 0 0 
ZAM 0 0 0 
ZZ 0 0 0 
re 3 0 Leo 
24 Lego 0 0 
X eee. eet O2E0 
O Cece Oe t Oe uk 


oul 





Subjects 


1 
Z 
b 
4 
3 
6 
y 
8 
J 
10 


hp eS RS 
PWN FH 


wn 


NNNNN RR re 
RPWNDN ROO ONIN 


Mean Reaction Time (in Seconds) 
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Sei ao 
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a0Z 
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0D 


Eos 
ekg 
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APPENDIX F 


Figure 5 


Boxplots of Reaction Time Data 
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Figure 6 


Boxplots of Transformed 
Reaction Time Data 
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waves 


Stemleaf Plot of Trans- 
Formed Reaction Time Data 
of Alphanumeric Code 


Figure 8 


Steamleaf Plot of Trans- 
formed Reaction Time Data 
Otrco lor Code 
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Figure 9 


Stemleaf Plot of Trans- 
formed Reaction Time Data 
of Symbol Code 


ore mil ear | [arid Si ioe 4 | 


Zale 
Dee 
uy | 
Seley 
O22 | 
Gao on 
teh aie 
Bo 2 ers 
Se TOO ee oS 
Off LILI aaas7 ey? 
BO] AaALa ger??? 7 
OPT LE Lasar? 
FO aoe oo 7 
ile 
ye. 1OScCce 
Y311L446 
PALOQLAP SSOP 
ols 
74611336 
SIV Ga ae 
YoOIlD Lia o3 
Ly ome 
OO 
OL | 
vei 
OS lS 
04 | 
OUT I. 
OG es 


? 


O7 14 


63 





APPENDIX H 


APL - Functions for Boxplots and Stemleafs 
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